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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

Applicant : Hugh Boyd Morrison, Anthony Edward Stuart, 
Robert Joseph Logan, Charles Bryan Hunt, 
Megan Louise Brown and Jill Suzanne Allen 

Filed : Herewith 

For : METHOD FOR SELECTING A PROGRAM DISPLAYED 

IN AN ADVERTISEMENT IN AN APPLICATION 
SOFTWARE PROGRAM 

PRELIMINARY AMENDMENT 

Hon. Commissioner of Patents and Trademarks 
Box PCT 

Washington, D.C. 20231 
Sir: 

In the US national phase application of PCT/US99/30761 filed 
herewith, please enter the following amendments: 

IN THE SPECIFICATION: 

Please amend the specification as follows: 

On Page 1 , line 3, insert the following paragraph: 

— This application claims the benefit of U.S. provisional 
application serial no. 60/1 14,077 filed December 28, 1998, which is hereby 
incorporated herein by reference, and which claims the benefit under 35 
U.S.C. § 365 of International Application PCT/US99/30761 , filed December 
22, 1999, which was published in accordance with PCT Article 21(2) on July 
6, 2000 in English.- 

IN THE ABSTRACT: 

Please add the following Abstract. 

-A video processing apparatus may be controlled 
in response to selecting an advertisement displayed in connection with a 
productivity or communication application software program being operated 
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09/868254 
Rec'd PCT/PTriTjuN 2M1 

IVlEmOJD^OJB^S^ 

IN AN,APEUCMl^^ 

FIELD OF INVENTION 
This invention generally relates to a method for operating a video 
processing apparatus in response to selecting an advertisement, or the like, 
which is displayed in connection with a productivity or communication 
application software program. 

BACKGROUND OF INVENTION 
Electronic Program Guides (EPGs) allow viewers to select any 
channel at any time during some period into the future, e.g., up to seven days 
forward. (The data associated with the EPG is typically broadcast in connection 
with a specified television channel at a certain time during the day.) Once a 
particular program is selected, for example, by highlighting, the viewer can 
perform audio/video processing like functions pertaining to that selected 
program. For instance, the viewer could instantly switch to that program if it is 
currently being aired or initiate a one-touch videocassette recording (VCR) if the 
television is properly configured and connected to a recording device. 

A communication application software program, such as electronic 
mail ("e-mail") or electronic instant messaging, running on a computer connected 
by a network, such as, the Internet, permits a user to send and receive 
electronic messages to and from another user/computer. Proprietary "on-line" 
networks usually provide such services to users for a monthly fee. Some on-line 
services display advertisements within the context of the communication 
application software program. Similar to advertisements on a typical "web- 
page'', these advertisements may be selected to obtain more information 
concerning a product or service. Selection of an advertisement usually connects 
the user to the web-page associated with the manufacturer of the product or the 
provider of the service. 
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There is consequently a need in the art for a convenient way to 
pernnit operation of an audio/video processing apparatus in response to the 
selection of an advertisement, for a particular television program or movie, that 
is displayed in connection with a productivity or communication application 
5 software program. 

SUMMARY OF THE INVENTION 
The present invention resides, in part, in recognition of the 
described problem and, in part, in providing a solution thereto. The present 
10 invention provides a convenient way of permitting a video processing apparatus, 
Q such as a television, VCR, DVD, satellite receiver, set-top box, or the like, to be 
J:; controlled in response to an advertisement displayed in connection with a 
f productivity or communication application software program. The productivity 
ni or communication application software program is operated on the video 
.15 processing apparatus and, usually, connected to a network, such as the Internet. 
1, Control information associated with the advertisement is used to operate the 
video processing apparatus in a typical video operating mode. The present 
invention links the traditional functions of a video processing apparatus with 
^ those of a personal computer. 
20 Generally, the present invention defines a method for operating a 

video processing apparatus. The method comprises operating a computer 
software program, such as, a productivity or communication application, on the 
video processing apparatus. An advertisement associated with a broadcast or 
transmittted television program is received in connection with the computer 
25 software program; the advertisement is displayed. The video processing 
apparatus is operated in a video-operating mode in response to selecting an 
advertisement. This invention is applicable with any program transmission 
means, for example, terrestrial, cable, satellite or the like. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 shows an example of a television system in accordance with 

the present invention; 

Fig. 2 shows an example of a digital video processing apparatus in 

accordance with the present invention; 

Fig. 3 shows a software block diagram in accordance with the 

present invention; 

Fig. 4 shows an electronic message display according to an 
implementation of the present invention; and 

Fig. 5 shows a subsequent electronic message display in 
accordance with the present invention. 

DETAILED DESCRIPTION 
Although the present invention is conveniently described in terms of 
a television apparatus, it is apparent to one skilled in the art that the present 
invention is applicable to any video processing apparatus that is capable of 
running a productivity or communication application software program and can 
generate or control a display device, for example, a VCR, DVD, satellite receiver, 
set-top box or the like. 
20 The television receiver shown in Fig. 1 is capable of processing 

both analog NTSC television signals and Internet information. Descriptions of 
the remaining well-known functions of the television receiver shown in Figure 1 
are not provided except where necessary for understanding the present 
invention. Tuner 1 105 and IF processor 1 1 30 operate in a conventional manner 
25 for tuning and demodulating a particular television signal that is included in signal 
RFJN. The system shown in FIG. 1 also includes a main microprocessor 

1 1 10 for controlling components of the television receiver such as tuner 1 105, 
picture-in-picture processing unit 1 140, video signal processor 1 1 55, and 

Gemstar® data processing module 1 160. 
30 Main microprocessor 1110 also controls the operation of a 

communications interface unit 1 1 13 for providing the capability to upload and 
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download information to and from the Internet. Communication interface unit 
1113 includes, for example, a modem for connecting to an Internet service 
provider, e.g., via a telephone line or via a cable television line. The 
communication capability allows the system shown in Figure 1 to provide 
electronic message capability and Internet related features such as web 
browsing in addition to receiving television programming. The electronic 
message capability is provided using an e-mail program running on 
microprocessor 1110, which permits connection to the Internet. CPU 1112 
controls functions included within microprocessor 1 1 10 , for example, auxiliary 
data processor 1115 and on-screen display (OSD) processor 1117, Auxiliary 
data processor 1115 extracts auxiliary data such as Gemstar data from video 
signal PIPV. 

Gemstar® data, which provides program guide data (e.g., EPG) 
information in a known format, is typically received only on a particular television 
channel and the television receiver must tune that channel to extract Gemstar 
data usually during a time period when the television receiver is typically not in 
use {e.g., 2:00 AM). At that time, CPU 1112 configures decoder 1115 such 
that auxiliary data is extracted from horizontal line intervals such as line 1 6 that 
are used for Gemstar® data. For an EPG display, the display data included in the 
EPG display is produced by OSD processor 1117 and included in the output 
signal by VSP 1155 in response to fast switch signal FSW, 

An exemplary embodiment of the features of the system shown in 
FIG. 1 that have been described thus far comprises an ST9296 microprocessor 
produced by SGS-Thomson Microelectronics; an M65616 picture-in-picture 
processor produced by Mitsubishi; and an LA7612 video signal processor 
produced by Sanyo. 

Figure 2 is an MPEG compatible system for receiving MPEG 
encoded transport streams representing broadcast programs and is also capable 
of processing Internet information, including electronic messages. User interface 
systems are also applicable to other types of digital signal processing devices 
including non-MPEG compatible systems, involving other types of encoded 
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datastreams (e.g., digital video disc (DVD) systems). The exemplary system 
described below is described as processing broadcast programs. The term 
'program' is used to represent any form of packetized data such as telephone 
messages, computer programs, Internet data, audio presentations (e.g., from a 
5 remote source or from a local source}, visual presentations, audiovisual 
presentations (e.g., from a remote source or a local source), or other 
communications. Descriptions of the remaining well-known functions of the 
television receiver shown in Figure 2 are not provided except where necessary 
for understanding the present invention. 
10 A carrier modulated with video data is received by antenna 1 0 and 

- processed by input processor unit 15. The resultant digital output signal is 

demodulated by demodulator 20 and decoded by decoder 30. The output from 
decoder 30 is processed by transport system 25, which provides compressed 
data outputs for storage, further decoding, or communication to other devices. 

] 15 Video and audio decoders 85 and 80 respectively, decode the compressed data 

L from system 25 to provide outputs for display. 

The data provided to mux 37 from selector 35 is in the form of an 

if: MPEG compliant packetized transport datastream as defined in MPEG systems 

'2 standard section 2.4 and includes program guide information and the data 
20 content of one or more program channels. Packet Identifiers (PIDs) identify the 
individual packets that comprise particular program channels. The transport 
stream contains Program Specific Information (PSI) for use in identifying the PIDs 
and assembling individual data packets to recover the content of all the program 
channels that comprise the packetized datastream. Transport system 25, under 
25 the control of the system controller 1 15, acquires and collates program guide 
information from the input transport stream, storage device 90 or an Internet 
service provider via the communication interface unit 116. The individual 
packets that comprise either particular program channel content or Program 
Guide information, are identified by their Packet Identifiers (PIDs) contained 
30 within header information 
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Packets received by decoder 55 from units 45 and 50 that contain 
program content including audio, video, caption, and other information, are 
directed by unit 65 from decoder 55 to the designated application device buffers 
in pacicet buffer 60. Application control unit 70 sequentially retrieves the audio, 
5 video, caption and other data from the designated buffers in buffer 60 and 
provides the data to audio and video decoders 80 and 85 and high speed data 
port 75. 

In addition, controller 1 15 is coupled to a communication interface 
unit 1 1 6 that operates in a manner similar to interface unit 1 1 1 3 of Figure 1 . 
10 That is, unit 116 provides the capability to upload and download information to 
and from the internet. Communication interface unit 116 includes, for example, 
a modem for connecting to an Internet service provider, e.g., via a telephone line 
ff= or via a cable television line. The communication capability allows the system 
r|: shown in Figure 2 to provide electronic message capability and Internet related 
tis features such as web browsing in addition to receiving television programming. 
;^ The electronic message capability is provided using an e-mail program running on 
:n microprocessor 1 15, which permits connection to the Internet, 
•j; Typically, however, the computer-related programs and operations, 

J; (such as, e-mail) are implemented independently of the television programs and 
20 operations. That is, composing, reading and/or sending e-mail is performed 

independent of any video processing operation, for example, tuning, recording, 
and/or replaying of audio, video, or television programs. Likewise, the audio, 
video, or television programming, tuning, recording and/or replaying is performed 
independent of the computer-related program that may be running on the digital 
25 television. 

Fig. 3 is a software block diagram or flow chart of an exemplary 
program which, according to the present invention, may be executed by 
controller 1 1 1 0 of Fig. 1 , controller 1 1 5 of Fig. 2, or any other suitably 
programmed control arrangement of an electronic host device. The term 
30 "electronic host device" as used herein is not limited to television receivers, 
video recording devices or set-top boxes, but rather encompasses hybrids 
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thereof (e.g., PCTVs), satellite television and/or data signal converters, program 
guide receiver units, and the like, regardless of whether incorporated into a 
television receiver or persona! computer or connected externally thereto. The 
exemplary program will be described below only with respect to the exemplary 
5 hardware implementation of an electronic host device shown in Fig. 1 . 

According to the exemplary program 300, an advertisement for a 
program is presented within the display of a communication or productivity 
application software program 301 . In response to a user's selection 302 of a 
displayed advertisement, a list of choices 310 may be provided. Alternatively, 
10 the receiver could operate based on a default mode, for example, immediately 
selecting the channel with the advertised program, or in response to the user 
%D desiring to record the program advertised {perhaps by activating a RECORD 
01 button), immediately set up a one-touch recording. 

if the choice list is shown, the user selects one of the choices, and 
^5 the receiver responds correspondingly. For example, if the choice is to tune to a 
- channel 31 2, the receiver will immediately tune to the subject channel. This 

may be achieved by either presenting the video in a small window and the user 
Jt may continue to use the application software program, or the video will take up 
O the entire screen and the user must actively return to the application. The user^s 
20 work is automatically saved regardless of the selected choice. Alternatively, a 
dialog box may appear asking the user whether to save the current work or not. 

Another choice would be to control the receiver to tune to the 
subject channel just prior to the start of the program 316 and 318. Alternately, 
the user could choose to record the program 320. This would result in 
25 programming a timer, for example, in the television or the video recording 
apparatus 322. 

In accordance with the present invention, the computer application 
software program, for example, a productivity or communication application is 
operated in a video processing apparatus, such as a television, VCR, DVD or the 
30 like. A user selects an advertisement (or possibly an icon associated therewith) 
that is displayed within the context of computer application software program. 
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Figure 4 illustrates one such communication application software program, i.e., 
an electronic mail message program 400. Electronic mail message program 400 
is operated on a video processing apparatus, for example, the television receiver 
of Figure 1 or 2, or any other appropriate video processing apparatus. Other 
5 electronic messaging programs, for example, instant messaging, may also be 
employed with the present invention. Further, productivity application software 
programs, such as, word processing, spreadsheets or the like, may also be 
employed with the present invention. 

An advertisement 402 is displayed within an area of electronic mail 

10 message program display 400. A typical electronic message display 400 

includes fields 404 for the SENDER, the RECIPIENT, the SUBJECT and the body 

S of the MESSAGE. In addition, display 400 also include ICONs 406, which can 

m be selected to invoke certain functions, such as, SEND a message, READ a 

f: message, view the user's ADDRESS BOOK, etc. 

ijs Upon selection of the advertisement 402, the video processor 

receives the data {i.e., advertisement data) associated with the advertisement. 
% This advertisement data may include program start time, program end time, 
it program duration; the channel via which the program is transmitted, and 
C characteristic information, and combinations thereof. Examples of the 
20 characteristic information include program title, program theme, program 

category, program keywords, a program description, program type {e.g. audio, 
video, audiovisual, computer, Internet, and the like), and program repeat 
frequency (e.g., once per week, daily, etc.). 

Figure 5 shows an optional and subsequent display. of the 
25 communication application program of Figure 4 in response to the user's 

selection of advertisement 402. Figure 5 illustrates an embodiment of a user 
selection display 500 in which the user is presented with certain options that 
may be selected. For example, the user may choose to now tune to the channel 
that the program will be broadcast on 502. Alternately, the user may choose to 
30 automatically tune to that channel when the program starts 504 or program a 
recording timer to establish a recording event 506. Further, the user may select 
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to visit an appropriate web site 508 related to the selected advertisement. The 
display of Figure 5 may not be produced; upon selection of advertisement 402, 
the video processing apparatus may either directly tune to the appropriate 
channel or set-up a recording event without further user intervention. 

Thus, the video processing apparatus can now be operated in a 
video-operating mode, for example, automatically selecting a channel, in 
response to the advertisement data if it is currently being aired. Alternately, if 
the program is not currently available, the video processing apparatus may be 
operated to set-up to automatically record the program in the future. This may 
be achieved by setting-up a "one-touch recording" operating mode or by 
programming timers with the CHANNEL and TIME information. If the 
advertisement data only contains "program information", such as the name of 
the program, then the data can be processed by the electronic program guide to 
determine the CHANNEL and TIME information. 

One touch recording involves setting up a programmed event in the 
video processing apparatus that receives the electronic program guide, usually, 
the television. At the appropriate time, the television controls the recording 
device. The invention also embraces the concept of conflict management. That 
is, if the selection of an advertisement results in the setting up of a one-touch 
recording which may conflict with an existing programmed event in the recording 
device, the system must be able to resolve the conflict. One possible outcome 
is that the most recent desires of the user, i.e., the selection of the 
advertisement overrides the existing programmed event. Another option would 
be to indicate the conflict to the user when the advertisement is selected, 
thereby allowing the user an opportunity to resolve the conflict. 

While the present invention finds much usefulness in the realm of 
electronic host devices, which are connected to or defined by a television set, 
the present invention is not limited to such electronic host devices. The present 
invention may be implemented, for example, with a computer as the electronic 
host device. This invention may also be employed with advertisements for 
programs that are displayed in connection with web browsers. It is to be 
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understood that the embodiments and variations shown and described herein are 
for illustrations only and that those skilled in the art by implement various 
modifications without departing from the scope and spirit of the invention. 
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CLAIMS 

1 . A method for operating a video processing apparatus comprising the steps 
of: 

operating a computer application software program on said video 
5 processing apparatus; 

receiving, in connection with said computer application software program, 
an advertisement associated with a broadcast television program; 
causing said advertisement to be displayed; 
selecting said advertisement; and 

10 operating said video processing apparatus in a video operating mode in 
response to said advertisement. 

11 2. The method of Claim 1 wherein said computer application software program 
vlj is one of a productivity and communication application software program. 

3. The method of Claim 2 wherein said advertisement comprises control 
:n information associated therewith, said control information comprising at least 
one of (1) time and channel selection data and (2) recording data. 

20 4. The method of Claim 3 wherein said control information comprises program 
data, and wherein time and channel data is determined using an electronic 
program guide in response to said program data. 

5. The method of Claim 1 wherein said step of operating comprises controlling a 
25 video recording device, interconnected thereto, to record a program associated 
with said advertisement. 
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RECEIVER RETURNS TO THE 
PRODUCTIVITY OR COMMUNICATIONS 
APPLICATION WITH NO CHANGE 
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